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METHOD FOR PARITY ANALYSIS AND REMEDY CALCULATION 

10 RELATED APPLICATION 

This U.S. patent application claims priority to U.S. Provisional Patent 
Application Serial No. 60/260,760 entitled "PARIS: Parity Analysis and Remedy 
Information System" filed January 9, 2001 which is incorporated herein by reference. 

5 TECHNICAL FIELD 

This invention relates in general to the analysis of data, and more particularly 
to analyzing performance measurement data to determine whether parity exists 
between the services provided by an incumbent local exchange carrier to its customers 
and the services provided by the incumbent local exchange carrier to the customers of 

) a competing local exchange carrier. 

BACKGROUND OF THE INVENTION 

At one time, a local telephone market was served by a single local exchange 
carrier. However, local telephone markets are now open to competition from 
competitive local exchange carriers ("CLECs"). The incumbent local exchange 
carrier ("ILEC") in a market is required to offer services to the CLECs that are 
equivalent to the services that it provides itself so that a competitive environment 
exists. 

To determine whether an ILEC is providing services to the customers of a 
CLEC that are equivalent to the services that it provides its own customers, data is 
collected that measures the performance of the services provided to the ILEC's 
customers and the performance of the services provided to the CLECs customers. 
One system for collecting transactional data and calculating performance 
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measurements is described in U.S. Patent Application No. 09/474,356 entitled 
"Method for Performance Measurement and Analysis of Local Exchange Carrier 
Interconnections" which is incorporated herein by reference. The performance 
measurements typically measure the timeliness, accuracy and availability of the 
5 services provided. For example, a performance measurement can be defined to 
measure the percentage of missed repair appointments. 

Although the ILEC is required to provide equivalent services, there is no 
established method for determining whether the services provided are equivalent. 
Thus, there is a need for a method for determining whether an ILEC is providing 
10 services to the customers of a CLEC that are equivalent to the services that it is 
providing to its own customers. The method should be flexible enough to 
accommodate a variety of performance measurements so that a comprehensive 
comparison can be made. 

If the ILEC does not provide services to the CLECs that are at least equal in 
1 5 quality to the services provided to the ILEC itself, then the ILEC may be subject to 
penalties. For example, a state public service commission ("PSC") may impose 
monetary penalties for the failure to provide equivalent services or the ILEC may be 
denied entry into the long distance market. Thus, there is a need for a method for 
calculating a remedy if the ILEC is not providing services to the customers of a CLEC 
20 that are equivalent to the services that it is providing to its own customers. The 

method should be flexible enough to accommodate a variety of penalties that may be 
imposed by PSC's in different states. 



SUMMARY OF THE INVENTION 

The present invention meets the needs described above by providing a method 

for determining whether parity exists between the services provided by an ILEC to its 
customers and the services provided by the ILEC to the customers of a CLEC. In 
addition, the present invention provides a method for calculating a remedy if parity 
does not exist. 

In one aspect of the invention four types of performance measurements are 
used to determine Whether parity exists: 1) mean measurements, 2) proportion 
measurements, 3) rate measurements and 4) ratio measurements. The performance 
measurements typically measure the timeliness, accuracy and availability of the 
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services provided by the ILEC. The performance measurement data is obtained from 
a performance measurement and analysis system. 

The data is loaded into a number of fact tables. The fact tables are created so 
that each row corresponds to a transaction. Once the fact tables are loaded, a number 
5 of relation tables are created. The relation tables are created so that each row 
corresponds to a performance measurement. 

A number of aggregation tables are also created. The aggregation tables 
contain summarized data that is used in determining whether parity exists. The 
aggregation tables aggregate performance measurements based on factors, such as 
) product group, product, entity, geography and time, so that a like-to-like comparison 
is made. Once the aggregation tables are created, a number of cell tables are created. 
Each row in a cell table corresponds to a performance measurement and contains data 
for a service provided by the ILEC to its customers and data for an analogous service 
provided by the ILEC to a CLECs customers. 

An individual Z-score is calculated for each row in a cell table. The individual 
Z-score reflects the difference between the average of the ILEC performance 
measurements and the average of the CLEC performance measurements. Once the 
individual Z-scores are calculated, an aggregate Z-score is calculated. The aggregate 
Z-score aggregates the individual Z-scores that are related to a particular CLEC. 

A balancing critical value ("BCV") is calculated so that the probability of a 
type I error and the probability of a type II error are equal. A type I error results if the 
calculation indicates that favoritism exists, when no favoritism exists and a type II 
error results if the calculation indicates that parity exists, when favoritism exists. 

To determine whether parity exists, the difference between the aggregate Z- 
score and the BCV is calculated. If the difference is negative, then it is determined 
that favoritism exists and an appropriate remedy is calculated. However, if the 
difference is not negative, then parity exists and no remedy is required. 

These and other aspects, features and advantages of the present invention may 
be more clearly understood and appreciated from a review of the following detailed 
description of the disclosed embodiments and by reference to the appended drawings 
and claims.. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram illustrating an exemplary system for analyzing parity 
and calculating a remedy, in accordance with an embodiment of the invention. 

Figs. 2A and 2B arc flow diagrams illustrating an exemplary method for 
5 analyzing parity and calculating a remedy, in accordance with an embodiment of the 
invention. 



DETAILED DESCRIPTION OF THE INVENTION 

The present invention is directed to a method for analyzing performance 
1 0 measurement data to determine whether parity exists between services provided by an 
incumbent local exchange carrier ("ILEC") to its customers and services provided by 
the ILEC to the customers of one or more competitive local exchange carriers 
("CLECs"). Briefly described, the method uses statistical analysis to compare 
performance measurements for the services provided to the ILEC's customers with the 
1 5 services provided to the CLECs customers to determine if parity exists. The method 
compares performance measurements at appropriate levels so that a like-to-like 
comparison is made. If it is determined that parity does not exist, then the method 
calculates a remedy. The remedy can be based upon a comparison between the 
performance measurements for the ILEC and a particular CLEC or upon a comparison 
20 between the performance measurements for the ILEC and all the CLECs within a 
state. 

EXEMPLARY OPERATING ENVIRONMENT 

An exemplary operating environment for the present invention is illustrated in 
25 Fig. 1 . Figure 1 includes a performance measurement and analysis platform (the 
"PMAP system") 120. The PMAP system uses transactional data from some of the 
processes that an ILEC uses to provide services to its customers and to the customers 
of the CLECs. Figure 1 illustrates several exemplary processes, including a pre- 
ordering process 102, an ordering process 104, a provisioning process 106, a 
30 collocation process 108, a billing process 1 10, a maintenance and repair process 1 12, 
and a trunk blockage process 114. Additional processes can also be included. The 
transactional data is collected from the processes by the PMAP system and is used to 
calculate a number of performance measurements. The performance measurements 
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measure the timeliness, accuracy and availability of the services provided by an 1LEC 
to its customers and the services provided by the ILEC to the customersof one or 
more CLECs. An exemplary PMAP system is described in U.S. Patent Application 
No. 09/474,356 entitled "Method for Performance Measurement and Analysis of 
Local Exchange Carrier Interconnections" (the "PMAP Application"), which is 
incorporated herein by reference. 

The PMAP system provides transactional data to a parity analysis and remedy 
information system (the "PARIS system") 130. The PARIS system typically uses a 
subset of the performance measurements calculated by the PMAP system. The 
PARIS system analyzes the performance measurements to determine whether parity 
exists between the services provided by an ILEC to its customers and the services 
provided by the ILEC to the customers of a CLEC. If parity does not exist, then the 
PARIS system calculates a remedy 142. Two types of remedies are calculated. One 
type of remedy is paid to a particular CLEC based on a comparison between the 
performance measurements for the ILEC and the performance measurements for the 
CLEC. A second type of remedy is paid to a public service commission ("PSC") and 
is based on a comparison between the performance measurements for the ILEC and 
the performance measurements for all of the CLECs within a state. 

PERFORMANCE MEASUREMENTS 

Typically, performance measurements include percentage, interval and 
accuracy measurements. A performance measurement that measures a percentage is 
defined to be an actual number divided by a total or scheduled number and multiplied 
by 100. For example, a missed repair appointments performance measurement is 
defined as follows: 

Percentage of missed repair appointments = £ (count of 
customer troubles not cleared by the quoted commitment 
date and time) / £ (total trouble reports closed in reporting 
period) x 100 

A performance measurement that measures an interval is defined to be an 
actual time interval for an event divided by the total number of events. For example, 
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an average completion interval performance measurement is defined as follows: 

Average Completion Interval =£ [(completion date and 
lime) - (order issue date and time)] / £ (total orders 
completed in reporting period) 

A performance measurement that measures accuracy is defined to be the 
percentage of correct events to total events. For example, an invoice accuracy 
performance measurement is defined as follows: 

Invoice Accuracy = (total billed revenues) - (billing related 
adjustments) / (total billed revenues) 

In the exemplary embodiment described herein, a subset of the performance 
measurements calculated by the PMAP system are used to determine whether parity 
exists between the services provided by an ILEC to its customers and the services 
provided by the ILEC to the customers of a CLEC. There are four types of 
measurements: 1) mean measurements, 2) proportion measurements, 3) rate 
measurements and 4) ratio measurements. The proportion and rate measurements are 
examples of percentage measurements, the mean measurements are examples of 
interval-measurements and the ratio measurements are examples of accuracy 
measurements. The following tables summarize the performance measurements used 
in the exemplary embodiment to determine whether parity exists. In addition, a ratio 
measurement, such as invoice accuracy, can also be used. Additional information on 
25 the performance measurements can be found in the PMAP Application. 
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Mean Measurements 

Order Completion Interval (Dispatch only) - POTS : 

Order Completion Interval (Dispatch only) - Design 

Order Completion Interval (Dispatch only) - UNE Loop & Port Comb 

Order Completion Interval (Dispatch only) - UNE Loops 

Order Completion Interval (Dispatch only) - IC Trunks 

Maintenance Average Duration - POTS 

Maintenance Average Duration - Design 

Maintenance Average Duration - UNE Loop & Port Comb 

Maintenance Average Duration - UNE Loops 

Maintenance Average Duration -IC Trunks 

Table 1 



Proportion Measurements 

Percent Missed Installation Appointments - POTS 

Percent Missed Installation Appointments - Design 

Percent Missed Installation Appointments - UNE Loop and Port Comb 

Percent Missed Installation Appointments - UNE Loops 

Percent Provisioning Troubles within 'x' Days - POTS 

Percent Provisioning Troubles within c x* Days - Design 

Percent Provisioning Troubles within «x' Days - UNE Loop and Port Comb 

Percent Provisioning Troubles within V Days - UNE Loops 

Percent Missed Repair Appointments - POTS - 

Percent Missed Repair Appointments - Design 

Percent Missed Repair Appointments - UNE Loop and Port Comb 

Percent Missed Repair Appointments - UNE Loops 

Percent Repeat Troubles within V Days - POTS 

Percent Repeat Troubles within c x* Days - Design . 

Percent Repeat Troubles within c x' Days - UNE Loop and Port Comb 
1 Percent Repeat Troubles within 'x' Days - UNE Loops 

Table 2 

In the exemplary embodiment discussed herein, the V days refers to 30 days. 
However, other embodiments can use a different time period. 

10 
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Rate Measurements 

Customer Trouble Report Rate - POTS 

Customer Trouble Report Rate — Design 

Customer Trouble Report Rate -UNE Loop and Port Comb 
Customer Trouble Report Rate -UNE Loops 

Table 3 



in some instances the products offered by a CLEC to its customers are not 
identical to the products offered by an ILEC to its customers. In these instances, 
analogous products are identified so that a like-to-like comparison can be made. After 
a like-to-like comparison is done at the product level, the products are aggregated into 
product groups prior to remedy calculation. Tables 1-3 include references to various 
product groups. Product groups are used so that a like-to-like comparison is made 
between a performance measurement for an ILEC and a performance measurement for 
a CLEC. The product groups are summarized below in Table 4 and include POTS, 
Design, UNE loops, UNE loops and combos and IC trunks. 



Product Group 


Product 


Product Attributes 


POTS 


Residence 


Non-Design 




Business 


Non-Design 




PBX Non-Design 






- Centrcx/ESSX Non-Design 






ISDN Residence 


Non- Design 




ISDN Business 


Non-Design 








Design 


PBX Design 






Centrex/ESSX Design 






ISDN Design 






Design 










UNE Loops 


UNE 2 Wire Loop Non-Design 






UNE 2 Wire Loop Design 






UNE Loop Other 


Design + Non-Design 








UNE Loop+ Port 
Combos 


Combos — Loop + Port Design 






Combos - Loop + Port Non-Design 










IC Trunk 


Local Interconnection Trunks 


Design + Non-Design 



Table 4 
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Products are used to make a like-to-like comparison. As shown in Table 4, 
products include residence, business, PBX non-design, Centrex/ESSX non-design, 
ISDN residence and ISDN business in the POTS product group; PBX design, 
5 Centrex/ESSX design, ISDN design and design in the Design product group; UNE 2- 
wire loop non-design, UNE 2-wire loop design and UNE loop other in the UNE loops 
product group; combos-loop + port-design and combos-loop + port-non-design in the 
UNE loops and combos product group; and local IC trunks in the IC trunks product 
group. 

10 Factors other than product groups and products also can be used to make a 

like-to-like comparison. In the exemplary embodiment, dispatched transactions are 
compared to other dispatched transactions and non-dispatched transactions are 
compared to other non-dispatched transactions. In addition, a comparison is made 
between transactions that involve a similar number of circuits, for example, less than 

15 ten circuits or greater than or equal to ten circuits. Moreover, a comparison is made 
for similar types of orders, such as new orders, transfer orders, change orders or pre- 
wire orders. 

EXEMPLARY METHOD FOR ANALYZING PARITY AND CALCULATING A 
20 REMEDY 

Figures 2A and 2B illustrate an exemplary method for analyzing performance 
measurements to determine whether parity exists and if parity does not exist, 
calculating a remedy. The method 200 begins at the START step in Fig. 2A and 
proceeds to step 202. In step 202 transactional data is received from the PMAP 

25 system. The transactional data is loaded into a number of fact tables in step 204. In 
the exemplary embodiment discussed herein, there are two types of fact tables, 
transaction based fact tables and subject area fact tables. 

The transaction based fact tables include a service order fact table, a service 
line fact table, a service request fact table and a ticket fact table. The service order 

30 fact table contains service order transactions. The service line fact table contains 
service line information. The service request fact table contains performance 
measurements for services associated with a closed order. The ticket fact table 
contains trouble ticket transactions. Typically, multiple performance measurements 
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are associated with a single transaction. As an example, the generation of a trouble 
ticket is a single transaction that is associated with a number of performance 
measurements, including measurements for customer trouble report rate, percent 
repeat troubles within c x* days, and maintenance average duration. 
5 The subject area fact tables include billing fact tables, a coordinated customer 

conversion fact table, an LNP (local number portability) disconnect fact table, an OSS 
(operational support systems) interface fact table and navigator contract fact tables. 
Hie billing fact tables include a billing invoice accuracy fact table, a billing invoice 
timeliness fact table, a usage data delivery accuracy fact table and a usage data deliver 
10 timeliness fact table. The subject area fact tables contain data associated with the 
subject areas. 

Once the fact tables are loaded, the relation tables are created in step 206. In 
the exemplary embodiment, a relation table is created so that each row corresponds to 
a performance measurement for a particular transaction. The relation tables include a 
15 service order relation table, a service line relation table, a service request relation table 
and a ticket relation table. The performance measurement data for a relation table is 
obtained from the corresponding fact table. For example, the performance 
measurement data for the service order relation table is obtained from the service 
order fact table. 

20 From step 206, the method proceeds to step 208 and the aggregation tables are 

created. The aggregation tables contain summarized data that is used in determining 
whether parity exists. The aggregation tables aggregate performance measurements at 
an appropriate level so that a like-to-like comparison is made. In the exemplary 
embodiment, the performance measurements are aggregated based on product group, 

25 product, entity, geography and time. The product groups and products used in the 

exemplary embodiment are summarized in Table 4 above. Entity refers to the ILEC, a 
particular CLEC or all of the CLECs within a state. Geography refers to location, 
such as a wire center, and state information. Time refers to a time period, usually the 
first half of the month or the second half of the month. Each row in an aggregation 

30 table is related to a measurement and contains summarized information. For example, 
a row can contain summarized information for all of the transactions for a particular 
CLEC at a particular wire center for the first half of the month for a particular product. 
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In the exemplary embodiment, a mean aggregation table and a proportion rate 
aggregation table are created. The mean aggregation table is created using data from 
the service order fact table, the service order relation table, the ticket fact table and the 
ticket relation table. The proportion rate aggregation table is created using data from 
5 the service order relation table, the service line relation table and the ticket relation 
table. 

Once the aggregation tables are created, the cell tables are created in step 209. 
Each cell in the cell table corresponds to a performance measurement and contains 
data for a service provided by the ILEC to its customers and data for an analogous 

10 service provided by the ILEC to the customers of a CLEC. The measurements within 
a cell are referred to herein as a related pair of performance measurements. Each cell 
contains two averages, an ILEC average and a CLEC average. In addition, each cell 
contains two counts, an ILEC count and a CLEC count. The counts correspond to the 
number of transactions used to compute the average. 

1 5 For most performance measurements, if data does not exist for both the ILEC 

and the CLEC, then a cell is not created. However, if the performance measurement 
is a benchmark type of measurement, then a pair of performance measurements is not 
needed. The benchmark measurement is compared to a predetermined benchmark to 
determine whether the ILEC is providing an acceptable level of service to the CLEC. 

20 Once the cell tables are created in step 209, the method proceeds to step 210. 

In step 210 an individual Z-score is calculated for each row in the cell table. The 
individual Z-score reflects the difference between the average of the ILEC 
performance measurements and the average of the CLEC performance measurements 
in the cell and is also referred to herein as a difference measurement. Additional 

25 details on the calculation of the individual Z-scores are provided in the section entitled 
"Calculating the Z-scores." 

Once the individual Z-scores are calculated, the method proceeds to step 212. 
In step 212, an aggregate Z-score is calculated. The aggregate Z-score aggregates the 
individual Z-scores that are related to a particular CLEC. The aggregate Z-score is 

30 also referred to herein as an aggregate difference measurement. Additional details on 
the calculation of the aggregate Z-score are provided in the section entitled 
"Calculating the Z-scores." 
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Once th aggregate Z-scor is calculated, the method proceeds to step 214 in 
Fig. 2B and a balancing critical value ("BCV") is calculated. The BCV balances the 
probability of a type I error and a type II error. A type I error results if the calculation 
of the aggregate Z-score indicates that favoritism exists, when no favoritism exists 
5 and a type II error results if the calculation indicates that parity exists, when 

favoritism exists. The BCV is calculated so that the probability of a type I error is 
equal to the probability of a type II error. Additional details on the calculation of the 
BCV are provided in the section entitled "Calculating the Balancing Critical Value." 

From step 214 the method proceeds to step 216. In step 216, the difference 
10 between the aggregate Z-score and the BCV is calculated. In step 218 a determination 
is made as to whether the difference calculated in step 216 is negative. If the 
difference is negative, then it is determined that favoritism exists and the method 
proceeds along the YES branch to step 220. 

In step 220 a remedy is calculated. Two types of remedies are computed, a 
1 5 tier 1 remedy and a tier 2 remedy. A tier 1 remedy is a remedy paid to an individual 
CLEC and is typically computed on a monthly basis. A tier 2 remedy is a remedy 
paid to a public service commission ("PSC") and is typically computed on a three- 
month rolling basis. The tier 2 remedy considers measurements for all CLECs within 
a state. 

20 In the exemplary embodiment, a fee schedule is used to calculate the remedy. 

The fee schedule can be set by a PSC or by the ILEC, if the ILEC is making voluntary 
remedy payments. The number of failing CLEC transactions, Le. transactions where 
parity did not exist, is multiplied by the amount shown on the fee schedule to 
determine the amount of the remedy. In some instances the fee schedule also provides 

25 for an increased remedy payment if there have been consecutive months of favoritism. 
If so, then the remedy is adjusted if parity did not exist in a previous month. Once the 
remedy is calculated, the method ends at the END step. 

If the determination in step 218 is that the difference calculated in step 216 is 
not negative, then the determination is that parity exists. The method proceeds along 

30 the NO branch and the method ends at the END step. 
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CALCULATING THE Z-SCORES 

The individual Z-scores and the aggregate Z-score are statistical-distributions. 
An individual Z-score is a distribution that approximates a standard normal with a 
mean of zero and a variance of one. An individual Z-score is negative if the CLEC 
5 performance measurements are worse than the ILEC performance measurements. The 
calculation of an individual Z-score varies based on the type of performance 
measurement, i.e. different calculations are used for mean measurements, proportion 
measurements, rate measurements and ratio measurements. In addition, the 
calculation of an individual Z-score for a mean measurement varies based on the 

10 counts associated with the cell. 

The individual Z-scores are truncated by setting an individual Z-score to zero 
if it is positive. However, to limit the amount of cancellation that occurs in 
calculating the aggregate Z-score, an individual Z-score is left alone if it is negative. 
The theoretical mean and variance of each truncated Z-score is calculated under a null 

15 hypothesis that parity exists. The calculation of the theoretical mean and variance 

varies based on the type of measurement. The theoretical mean and variance are used 
to re-center and scale an aggregated weighted sum of the truncated Z-scores so that 
the aggregate Z-score (Z T ) follows a standard normal distribution. In the exemplary 
embodiment, the aggregate Z-score is calculated as shown below. 

£ w i z ;-z w i E ( z ;i H o) 

Z T = 



20 



^W/Var(Z;|H 0 ) 



where 

L = total number of occupied cells 
j = 1 , 2, 3. . .L; index for the cells 
Wj = cell weight for cell j 
25 Z*j = truncated Z-score for cell j 

E(Z*j |Ho) = theoretical mean under null hypothesis of parity 
Var(Z*j |H 0 ) = theoretical variance under null hypothesis of parity 

The aggregate Z-score is calculated for a particular CLEC (or for all CLECs), for a 
30 particular state and for a particular product. 
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CALCULATING THE BALANCING CRITICAL VALUE 

The BCV is calculated so that the probability of a type I error is equal to the 
probability of a type II error. A type I error results if the calculation indicates that 
favoritism exists, when no favoritism exists and a type II error results if the 
calculation indicates that parity exists, when there is favoritism. In the exemplary 
embodiment, the BCV (c B ) is calculated as shown below. 



£W j M(m ji 8e J )-£w J 1 



j I ^ 



M(M,a)=n<l>(^)-a<i>(^) 

V(u, a) = (u 2 + a 2 )d>(^) - \ia - M(u,a) 2 



where 

L = total number of occupied cells 
15 j = 1, 2, 3. . .L; index for the cells 

Wj = cell weight for cell j 
mj = mean 
sej = standard error 

0>( ) = cumulative standard normal distribution function 
20 <p( ) - standard normal density function 

The calculation of the mean and standard error differs based on the type of 
performance measurement. 

Additional alternative embodiments will be apparent to those skilled in the art 
25 to which the present invention pertains without departing from its spirit and scope. 
For example, additional or alternative performance measurements can be used and the 
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calculation of the individual Z-scores or the aggregate Z-score can be modified. 
Moreover, the use and organization of the fact tables, relation tables and aggregation 
tables can differ from that described herein. Accordingly, the scope of the present 
invention is described by the appended claims and is supported by the foregoing 
description. 
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